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.METHODS AND DEVICES FOR REDUCING TOTAL BANDWIDTH 
WHEN STREAMING MULTIPLE MEDIA STREAMS 

TECHNICAL FIELD 

Embodiments of the present Invention pertain to streaming media. 

BACKGROUND ART 

Television coverage of events, sucli as news or sporting events, 
typically uses multiple cameras. The event is captured live, and the 
audio/video content from each of the cameras is streamed back to a studio, for 
example. At the studio, the content is edited for broadcast. For example, an 
editor or producer can elect to broadcast the feed from one camera, then 
switch to the feed from another camera, and so on. This type of editing is 
typically performed whether the event is being broadcast live or being 
recorded for later broadcast. 

The content received at the studio is preferably of high broadcast 
quality as this will provide the best viewing experience. As viewers move to 
high definition televisions that offer high resolutions and large picture screens, 
the desire for high broadcast-quality content increases. 

The broadcast-quality content from each camera is transmitted via 
some type of communication network from the event to the studio. Typically, 
the content is transmitted via a wireless network such as a satellite network. 
Alternatively, the Internet can be used. 

However, and especially when multiple cameras are being used, a 
substantial amount of network bandwidth is needed to transmit the content to 
the studio. If the available bandwidth is insufficient, then there can be delays 
in receiving the content, an unsatisfactory situation particularly for events 
being broadcast live. 

Some conventional solutions address this problem by attempting to 
reserve a large amount of network bandwidth. However, reserving network 
bandwidth, especially in the amount needed, is expensive. Also, it may not be 
possible to reserve the bandwidth needed. For example, for breaking news 
events, It is not always possible to know in advance when and for long a large 
amount of bandwidth will be needed. 
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Other conventional solutions attempt to sidestep tlie networic bandwidth 
issue by capturing the content on storage devices such as video tapes or hard 
disl<s. and shipping the storage devices to the studio. While these solutions 
may be satisfactory in some instances, they are not satisfactory for live events 
5 or for those events in which there is interest in getting footage on the air as 
quickly as possible. 

Yet other conventional solutions attempt to address these problems by 
sending low bandwidth (e.g., low resolution) content over the communication 
10 network. However, this does not satisfy the preference for high resolution 
content at the broadcast source, as mentioned above. 

Thus, a method and/or system that can deliver broadcast quality 
content for an event covered by multiple cameras would be of value. 

15 
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DISCLOSURE OF THE INVENTION 

Embodiments of the present invention pertain to methods and devices 
for streaming multiple media streams. 

5 In one embodiment, a plurality of media streams is received. A media 

stream is selected. A service Is performed on each of the media streams 
except for the selected media stream. The service reduces the respective 
bandwidth of each media stream (except for the selected media stream) so 
that the total bandwidth of the media streams is reduced. The media streams 

10 including the selected media stream are then streamed to their destination. 
The media streams other than the selected media stream are streamed at less 
than their initial bandwidth, while the selected media stream is streamed at its 
initial bandwidth. 

15 In another embodiment, a plurality of media streams is received as 

described above. A service is performed on each of the media streams, the 
service reducing a respective initial bandwidth of each media stream. All of 
the media streams are streamed to their destination at less than their 
respective initial bandwidths. At least one media stream is then selected from 

20 the plurality of media streams. The selected media stream is streamed at its 
initial bandwidth. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and form a part 
of this specification, illustrate embodiments of the invention and, together with 
the description, serve to explain the principles of the invention: 

5 

Figures 1 A and 1 B illustrate data flow in a data streaming system 
according to one embodiment of the present invention. 

Figures 2A and 2B illustrate data flow in a data streaming system 
10 according to another embodiment of the present invention. 

Figure 3 illustrates data flow in a data streaming system according to a 
third embodiment of the present invention. 

15 Figure 4 illustrates data flow in a data streaming system according to a 

fourth embodiment of the present invention. 

Figure 5 is a flowchart of one embodiment of a method of streaming 
data according to the present invention. 

20 

Figure 6 Is a flowchart of another embodiment of a method of streaming 
data according to the present Invention. 

The drawings referred to in this description should not be understood 
25 as being drawn to scale except if specifically noted. 
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BEST MODE FOR CARRYING OUT THE INVENTION 

Reference will now be made In detail to various embodiments of the 
Invention, examples of which are illustrated in the accompanying drawings. 
While the Invention will be described in conjunction with these embodiments, 

5 it will be understood that they are not intended to limit the invention to these 
embodiments. On the contrary, the invention is intended to cover alternatives, 
modifications and equivalents, which may be included within the spirit and 
scope of the invention as defined by the appended claims. Furthermore, in 
the following description of the present invention, numerous specific details 

10 are set forth in order to provide a thorough understanding of the present 

invention. In other instances, well-known methods, procedures, components, 
and circuits have not been described in detail as not to unnecessarily obscure 
aspects of the present invention. 

15 Aspects of the present invention may be practiced on an Intelligent 

device such as a computer system that includes, in general, a processor for 
processing information and instructions, random access (volatile) memory 
(RAM) for storing Information and Instructions, read-only (non-volatile) 
memory (ROM) for storing static information and instructions, a data storage 

20 device such as a magnetic or optical disk and disk drive for storing information 
and instructions, an optional user output device such as a display device (e.g., 
a monitor) for displaying information to the computer user, an optional user 
input device including alphanumeric and function keys (e.g., a keyboard) for 
communicating information and command selections to the processor, and an 

25 optional user input device such as a cursor control device (e.g., a mouse) for 
communicating user input information and command selections to the 
processor. 

For purposes of clarity and brevity, the following discussion and 
30 examples deal with video data and audio data; however, the present invention 
is not so limited. In general, the present Invention is well suited to use with 
image-based data and audio-based data and the like, referred to generally 
herein as media data. 

35 Figures 1 A and 1 B illustrate data flow in a data streaming system 

according to one embodiment of the present invention. In the present 
embodiment, content sources 1 . 2 and 3 are communicatively coupled to 
network mixing device 1 1 , which in turn is communicatively coupled to editor 
device 13. The content sources 1 . 2 and 3, the network mixing device 1 1 , and 
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the editor device 13 communicate with each other over a communication 
network. The communication network may be a satellite network, an Internet 
Protocol network, or the like. The content sources 1 , 2 and 3, the network 
mixing device 1 1 , and the editor device 13 can therefore be in completely 
5 separate and perhaps distant locations. 

As will be seen, network mixing device 11 functions to reduce the total 
bandwidth associated with delivering content in real time from content sources 
1 , 2 and 3 to the editor device 13. Accordingly, editor device 13 can be a 
10 great distance from the content sources 1 , 2 and 3 without placing great 
demands on the communication network. The closer that network mixing 
device 1 1 is located to the content sources 1 , 2 and 3, the lower the demands 
on the communication network. 

15 In the examples of Figures of 1A and IB, as well as in the other 

examples described below in conjunction with Figures 2A, 2B, 3 and 4, it is 
understood that there may be one or more other nodes situated between the 
content sources and the network mixing device, and/or between the network 
mixing device and the editor device, as part of the communication network. 

20 Also, although three content sources are described, the present invention is 
not so limited. Furthermore, an editor device may be in communication with 
more than one network mixing device. Moreover, there may be more than one 
editor device, perhaps centrally controlled by another device. 

25 Referring to Figures 1 A and IB, the content sources 1 , 2 and 3 

communicate to the network mixing device 11, and the network mixing device 
1 1 communicates to the editor device 13, and vice versa, via wired or wireless 
communication or some combination thereof. Communications from the 
content sources 1 , 2 and 3 to the network mixing device 1 1 are via one or 

30 more high bandwidth connections. Communications from the network mixing 
device 1 1 to the editor device 13 can occur over connections that have high 
bandwidth capacity; however, as will be seen, the total bandwidth consumed 
by communications from the network mixing device 1 1 to the editor device 13 
are reduced relative to conventional approaches. Communications from the 

35 editor device 13 to the network mixing device 1 1 consist primarily of editing 
commands sent from the editor device 13 to the network mixing device 1 1 ; 
those communications can occur through a low bandwidth connection. 
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In general, content sources 1 , 2 and 3 are high bitrate (high resolution) 
streaming media sources. In one embodiment, content sources 1, 2 and 3 are 
cameras, specifically moving picture (e.g., video) cameras that can also record 
audio input. As cameras, the content sources 1 , 2 and 3 can be used during 

5 coverage of a live event (e.g., a news event or sporting event). The cameras 
may provide simultaneous but different views of a single physical area (e.g., a 
football field) or simultaneous recordings of physically separate areas (e.g., 
opposing campaign centers during an election). Images and sounds of the 
event can be captured in digital form, or in another form that is converted to 

10 digital form by either the content sources 1 , 2 and 3 or by a downstream 
device (e.g., by network mixing device 11). Content can be sent (e.g., 
streamed) from the content sources 1, 2 and 3 as the content is captured (e.g., 
in real time), or the content can be recorded, in whole or in part, and then sent. 
Significantly, the content sent from the content sources 1 , 2 and 3 to the 

15 network mixing device 11 is high bandwidth (e.g., high resolution, broadcast 
quality) content. Although the content from the content sources 1 , 2 and 3 can 
include both video and audio content, the present invention is not so limited. 

Thus, network mixing device 11 receives high bandwidth feeds (e.g., 
20 media streams) from each of the content sources 1 , 2 and 3. Network mixing 
device 1 1 performs processing of the audio and video content in selected 
media streams to reduce the bandwidth associated with the media streams 
selected. Based on information received from the editor device 13, network 
mixing device 1 1 can identify which media streams are to be processed to 
25 reduce bandwidth, and which media stream or streams are not to be 

processed to reduce bandwidth. It is appreciated that processing - other than 
processing to reduce bandwidth - might be performed by network mixing 
device 1 1 on all of the media streams. 

30 Processing operations that reduce the bandwidth of a media stream are 

referred to herein as transcoding operations. Transcoding operations include, 
but are not limited to, bitrate reduction, rate shaping, spatial downsampling 
(spatial resolution reduction), frame rate reduction, key frame selection, 
changing compression formats, data packet truncation, and data packet 

35 elimination. These transcoding operations, as well as various other 
transcoding operations not mentioned, are known in the art. 

Editor device 13 in essence provides remote control of the network 
mixing device 1 1 . Varying degrees of control can be exerted over network 
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mixing device 1 1 by editor device 13. In general, commands generated by a 
liuman editor are sent from the editor device 13 to the network mixing device 
1 1 . The commands are used to identify which of the media streams received 
by network mixing device 1 1 are to be processed to reduce bandwidth. The 
5 commands may be compiled into a list (an edit list) which is sent to network 
mixing device 1 1 , which then executes the commands in order according to 
the list. In one embodiment, commands are sent to the network mixing device 
11 using Synchronized Multimedia Integration Language (SMIL) files. 

10 The examples of Figures 1A and IB are now described in operation. In 

Figure 1 A, a live event is captured, in picture and/or sound, by content sources 
1 , 2 and 3. High bandwidth (e.g., high definition, high bitrate, etc.) content 
from content sources 1 , 2 and 3 is sent (e.g., streamed) to network mixing 
device 11. In response to a command from editor device 13, the content from 

15 content source 1 is selected as the feed (e.g., clip) to be broadcast (e.g., 

televised). Accordingly, the content from content source 1 is not processed to 
reduce its associated bandwidth, and the content from content sources 2 and 
3 is processed (e.g., transcoded) to reduce their respective bandwidths. 

20 Note that, before processing to reduce bandwidth, all or some portion of 

the high bandwidth media streams from the content sources 1 , 2 and 3 can be 
recorded on some type of storage device (e.g., on video tape or on a hard 
disk). In this manner, the high bandwidth content from all of the content 
sources can be retained and subsequently processed and edited, if so 

25 desired. 

In one embodiment, the same transcoding operation is applied to 
content sources 2 and 3. In another embodiment, different types of 
transcoding operations are applied on a stream-by-stream basis. In one 

30 embodiment, the commands sent from editor device 13 control the type of 
transcoding performed by network mixing device 1 1 , collectively or on a 
stream-by-stream basis. In other words, all media streams may be subject to 
the same transcoding operation, or each stream may be subject to different 
transcoding operations. Also, for any given stream, one type of transcoding 

35 operation may be applied, and then a change to a different type of transcoding 
operation may be made. 

In the present embodiment, all of the media streams are sent (e.g., 
streamed) over a communication network to the editor device 13. The high 
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bandwidth version of the media stream from content source 1, and the low 
bandwidth versions of the media streams from content sources 2 and 3, are 
sent to editor device 13. All of the media streams are sent to editor device 13 
so that a human editor or producer can make subsequent decisions about 
5 which of the feeds are to be broadcast. 

According to the present embodiment of the present invention, although 
all of the media streams are sent to the editor device 13, the total bandwidth 
consumed by the streams is reduced relative to the conventional art because 

10 some of the streams are transcoded. In the example of Figures 1 A and IB, 
only a single high bandwidth media stream is sent over the communication 
network; however, the present invention is not so limited. Even if more than 
one high bandwidth stream is sent to the editor device 13, a reduction in total 
bandwidth consumed is still realized as long as at least one of the content 

15 streams from the content sources 1 , 2 and 3 is reduced in bandwidth. 

Note that the transcoding operation is generally intended to reduce 
bandwidth, but the type of transcoding can be selected so that characteristics 
of the content that might be of particular interest can be retained even at 

20 reduced bandwidth. For example, a reduction in spatial resolution might 
make it difficult for a remote editor to discern whether or not a video camera 
has proper focus. Therefore, instead of transcoding by reducing spatial 
resolution, transcoding by key frame selection may be selected. The key 
frames are at high resolution but the bandwidth needed to send them to the 

25 editor device 13 is reduced by virtue of a reduced frame count. As noted 

above, the type of transcoding can be controlled on a stream-by-stream basis, 
and a change can be made from one type of transcoding operation to another. 

Referring now to Figure IB, a decision is made to broadcast (e.g., 
30 televise) the feed from content source 2. In the present embodiment, to 

implement this decision, a command is sent from editor device 13 to network 
mixing device 11. In response to the command, network mixing device 1 1 
starts transcoding of the media stream from content source 1 and continues 
transcoding of the media stream from content source 3, in order to reduce the 
35 bandwidth associated with those media streams. Also, network mixing device 
1 1 stops transcoding of the media stream from content source 2. The high 
bandwidth version of the media stream from content source 2, and the low 
bandwidth versions of the media streams from content sources 1 and 3, are 



9 



200313378-1 



sent to editor device 13. This process can be repeated as many times as 
needed or desired. 

Figures 2A and 2B illustrate data flow in a data streaming system 
5 according to another embodiment of the present invention. In general, the 
examples of Figures 2A and 2B share the features described above in 
conjunction with the examples of Figures 1A and IB. A difference between 
the examples of Figures 1 A and IB and the examples of Figures 2A and 2B is 
that, in the latter examples, a separate transcoder device is associated with 

10 each content source (e.g., transcoders 21 , 22 and 23 are separately 

associated with content sources 1, 2 and 3, respectively). It is understood that 
a system combining the examples of Figures 1A, IB, 2A and 2B is possible. In 
such a system, some content sources may share a transcoder device (e.g., a 
network mixing device), while other content sources may be associated with a 

15 dedicated transcoder. 

With reference to Figures 2A and 2B, the transcoders 21 , 22 and 23 can 
each receive commands from the editor device 25. Thus, although the 
transcoders 21-23 are to a degree independent of each other, they operate 
20 under control of the editor device 25 and, in community, are similar in function 
to the network mixing device 1 1 of Figures 1 A and 1 B. 

The examples of Figures 2A and 2B are now described in operation. In 
Figure 2A, a live event is captured, in picture and/or sound, by content sources 

25 1,2 and 3. High bandwidth (e.g., high definition, high bitrate, etc.) content 
from content sources 1 , 2 and 3 is sent (e.g., streamed) to transcoders 21 , 22 
and 23, respectively. The content from content source 1 is selected as the 
feed (e.g., clip) to be broadcast (e.g., televised). Accordingly, in response to a 
command from editor device 25, the content from content source 1 is not 

30 processed by transcoder 21 to reduce bandwidth. Also in response to 

commands from editor device 25, the content from content sources 2 and 3 is 
processed (e.g., transcoded) by transcoders 22 and 23, respectively, to 
reduce bandwidths. The type of transcoding performed at each transcoder 
can be the same or different. 

35 

In the present embodiment, all of the media streams are sent (e.g., 
streamed) over a communication network to the editor device 25. The high 
bandwidth version of the media stream from content source 1 , and the low 
bandwidth versions of the media streams from content sources 2 and 3, are 
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sent to editor device 25. As previously discussed herein, although all of the 
media streams are sent to the editor device 25, the total bandwidth consumed 
by the streams is reduced relative to the conventional art because some of the 
streams are transcoded. In the example of Figures 2A and 2B, only a single 
5 high bandwidth media stream is sent over the communication network; 
however, the present invention is not so limited. 

Referring now to Figure 2B, a decision is made to broadcast (e.g., 
televise) the feed from content source 2. In the present embodiment, to 

10 implement this decision, a command is sent from editor device 25 to 

transcoders 21 and 22. In response to the commands, transcoder 21 starts 
transcoding of the media stream from content source 1 in order to reduce 
bandwidth, and transcoder 22 stops transcoding of the media stream from 
content source 2. A command from editor 25 can also be sent to transcoder 

15 23 to continue transcoding; however, the absence of such a command will 
also suffice. The high bandwidth version of the media stream from content 
source 2, and the low bandwidth versions of the media streams from content 
sources 1 and 3, are sent to editor device 25. This process can be repeated 
as many times as needed or desired. 

20 

Figure 3 illustrates data flow in a data streaming system according to a 
third embodiment of the present invention. In general, the example of Figure 3 
shares the features described above in conjunction with the examples of 
Figures 1A and IB. A difference between the examples of Figures 1A and IB 

25 and the example of Figure 3 is that, in the latter example, all of the media 
streams are reduced in bandwidth before they are sent to editor device 33. 
Accordingly, editor device 33 receives only the low bandwidth versions of the 
media streams. Based on the low bandwidth versions, a decision can be 
made to select for broadcast one of the high bandwidth feeds from the content 

30 sources 1 , 2 and 3. A command from editor device 33 identifies the content 
source selected for broadcast. Network mixing device 31 can then either 
broadcast the selected high bandwidth feed, or network mixing device 31 can 
fonward the selected high bandwidth feed to a downstream node other than 
the editor device 33. The other downstream node might be a broadcaster 

35 closer to the network mixing device 31 than the editor device 33, so the 
demand placed on the communication network is reduced. 

Figure 4 illustrates data flow in a data streaming system according to a 
fourth embodiment of the present invention. In general, the example of Figure 
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4 shares the features described above in conjunction with the examples of 
Figures 2A and 2B. A difference between the examples of Figures 2A and 2B 
and the example of Figure 4 is that, in the latter example, all of the media 
streams are reduced in bandwidth before they are sent to editor device 45. 

5 Accordingly, editor device 45 receives only the low bandwidth versions of the 
media streams. Based on the low bandwidth versions, a decision can be 
made to select for broadcast one of the high bandwidth feeds from the content 
sources 1 , 2 and 3. Commands from editor device 45 identify the content 
source selected for broadcast. In the example of Figure 4, the content from 

10 content source 3 is selected for broadcast. Transcoder 43 can then either 

broadcast the selected high bandwidth feed, or transcoder 43 can forward the 
selected high bandwidth feed to a downstream node other than the editor 
device 45. 



15 Figure 5 is a flowchart 50 of one embodiment of a method of streaming 

data according to the present invention. Figure 6 is a flowchart 60 of another 
embodiment of a method of streaming data according to the present invention 
Although specific steps are disclosed in flowcharts 50 and 60, such steps are 
exemplary. That is, embodiments of the present invention are well suited to 

20 performing various other steps or variations of the steps recited in flowcharts 
50 and 60. It is appreciated that the steps in flowcharts 50 and 60 may be 
performed in an order different than presented, and that not all of the steps in 
flowcharts 50 and 60 may be performed. All of, or a portion of, the methods 
described by flowcharts 50 and 60 can be implemented using computer- 

25 readable and computer-executable instructions which reside, for example, in 
computer-usable media of a computer system or like device. 

In one embodiment, flowchart 50 pertains to the examples of Figures 
1A, IB and 3. In such an embodiment, flowchart 50 is implemented using 
30 network mixing devices 1 1 and 31 of those figures. In one embodiment, 
flowchart 60 pertains to the examples of Figures 2A, 2B and 4. In such an 
embodiment, flowchart 60 is implemented by transcoders 21-23 and 41-43 of 
those figures. 

35 Referring first to step 52 of Figure 5, in the present embodiment, a 

plurality of media streams is received. In step 54, a media stream is selected. 
In one embodiment, information is received identifying which media stream is 
to be selected. 
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In step 56, a service is performed on eacli of the media streams except 
for the selected media stream. The service reduces the respective bandwidth 
of each media stream (except for the selected media stream) so that the total 
bandwidth of the media streams is reduced. In one embodiment, a different 
5 type of service can be performed on each of the media streams. In another 
embodiment, the same service is performed on all media streams. In those 
embodiments, information is received identifying the type of service(s) to be 
performed. Also, in one embodiment, the information in the media streams is 
recorded before the service is performed. 

10 

In step 58, the media streams including the selected media stream are 
then streamed to their destination. The media streams other than the selected 
media stream are streamed at less than their initial bandwidth, while the 
selected media stream is streamed at its initial bandwidth. 

15 

Referring now to step 62 of Figure 6, in the present embodiment, a 
plurality of media streams is received. 

In step 64, a service is performed on each of the media streams. The 
20 service reduces a respective initial bandwidth of each media stream. In one 
embodiment, a different type of service can be performed on each of the 
media streams. In another embodiment, the same service is performed on all 
media streams. In those embodiments, information is received identifying the 
type of service(s) to be performed. Also, in one embodiment, the information 
25 in the media streams is recorded before the service is performed. 

In step 66, all of the media streams are streamed to their destination at 
less than their respective initial bandwidths. 

30 In step 68, at least one media stream is then selected from the plurality 

of media streams. In one embodiment, information is received identifying 
which media stream is to be selected. The selected media stream is streamed 
at its initial bandwidth. 

35 In summary, embodiments of the present invention provide methods 

and systems that can deliver broadcast quality content in real time for a live 
event covered by multiple cameras. The invention utilizes a network mixing 
device that is relatively close to the content sources and that produces low 
bandwidth versions of media streams but still provides a high bandwidth. 
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broadcast quality stream. In effect, embodiments of the invention allow for 
pre-selection of content far from the event site, based on lower bandwidth 
representations, with only the selected content then fed at broadcast quality. 
This considerably reduces the total bandwidth needed to transmit broadcast 
5 quality content from multiple content sources over large distances without 
introducing large delays from the time that the content is captured until the 
time the content is disseminated (e.g., televised). 

Reducing the bandwidth needed for live event coverage avoids the 
10 need to set aside large amounts of bandwidth, reducing costs. Also, more 
efficient use of communication network resources is realized, considering that 
the product that is broadcast can only utilize one high quality feed at a time. In 
other words, network resources are not consumed by sending many high 
quality streams when only one of the streams is needed at a time. Because 
15 the other content feeds are also transmitted, although at lower bandwidth, a 
human editor still has fine grain control over how to composite the product that 
is broadcast. 

The foregoing descriptions of specific embodiments of the present 
20 invention have been presented for purposes of illustration and description. 
They are not intended to be exhaustive or to limit the invention to the precise 
forms disclosed, and it is evident many modifications and variations are 
possible in light of the above teaching. The embodiments were chosen and 
described in order to best explain the principles of the invention and its 
25 practical application, to thereby enable others skilled in the art to best utilize 
the invention and various embodiments with various modifications as are 
suited to the particular use contemplated. It is intended that the scope of the 
invention be defined by the Claims appended hereto and their equivalents. 
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